The dual horospherical Radon transform for polynomials 

J. Hilgert* A. Pasquale^ and E.B. Vinberg^ 
1 Introduction 

A Radon transform is generally associated to a double fibration 

Z 

v / V q 



x Y, 

where one may assume without loss of generality that the maps p and q are surjective and Z is 
embedded into X xY via z i-> (p(z), q{z)) . Let some measures be chosen on X, Y, Z and on the 
fibers of p and q so that 

f(u)du)dx = f f(z)dz = f If f(v)dv)dy. (1) 
x \Jp-\x) J Jz Jy yJq-Hy) J 

Then the Radon transform 1Z is the linear map assigning to a function ip on X the function on 
Y defined by 

(&>)&)= f (P*v)(v)dv, 
•iq-Hv) 

where we have set p*tp := (pop. In a dual fashion, one defines a linear transform TZ* from 
functions on Y to functions on X via 

(K*i>)(x) = f (q*^)(u)du. 
It is dual to TZ. Indeed, formally, 

(Kp,il>) ■■=[{[ (p*ip)(v)dv) 4>{y)dy 
Jy \Jq-Hy) J 

(p*tp)(q*ip){v) dv dy 

= [ (p* V )(z)(q*^)( Z )dz 
JZ 
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(q*ip)(u) du dx 



In particular, if X = G/K and Y = G/H are homogeneous spaces of a Lie group G, one can 
take Z = GJ (K n H), with p and q being G-equivariant maps sending e(K D H) to eK and eff , 
respectively. Assume that there exist G-invariant measures on X, Y and Z. If such measures 
are fixed, one can uniquely define measures on the fibers of p and q so that the condition ([!]) 
holds. (Here, speaking about a measure on a smooth manifold, we mean a measure defined by 
a differential form of top degree.) In this setting we can consider the transforms TZ and TZ*, 
and if dimX = dimY, one can hope that they are invertible. The basic example is provided 
by the classical Radon transform, which acts on functions on the Euclidean space E™ = (R™ X 
SO(n))/SO(n) and maps them to functions on the space HE n = (R" XSO(n))/(R" _1 XO(n- I)) 
of hyperplanes in E™ . 

For a semisimple Riemannian symmetric space X = G/K of noncompact type, one can 
consider the horospherical Radon transform as proposed by I.M. Gelfand and M.I. Graev in 



[ GG5£ ]. Namely, generalizing the classical notion of a horosphere in Lobachevsky space, one 
can define a horosphere in X as an orbit of a maximal unipotent subgroup of G. The group G 
naturally acts on the set HorX of all horospheres. This action is transitive, so we can identify 
HorX with some quotient space G/S (see §|| for details). It turns out that dimX = dim HorX. 
Moreover, the groups G, K, S and Kf)S — M are unimodular, so there exist G-invariant measures 
on X, HorX and Z = G/M. The Radon transform TZ associated to the double fibration 

G/M 



X = G/K G/S = HorX 



is called the horospherical Radon transform. 

The space Z = G/M can be interpreted as the set of pairs (x,TC) £ X x Hor X with x £ Tt, so 
that p and q are just the natural projections. The fiber q^ 1 (Ti) with Tt £ HorX is then identified 
with the horosphere H, and the fiber p _1 (x) with x £ X is identified with the submanifold 
Hor x X C HorX of all horospheres passing through x. Note that, in contrast to the horospheres, 
all submanifolds Hor x X are compact, since Hor x X is the orbit of the stabilizer of x in G, which 
is conjugate to K. 

In this paper, we describe the dual horospherical Radon transform TZ* in terms of its action 
on polynomial functions. Here a differentiable function ip on a homogeneous space Y = G/H of 
a Lie group G is called polynomial, if the linear span of the functions g<p with g £ G is finite 
dimensional. The polynomial functions constitute an algebra denoted by R[Y]. 

For X = G/K as above, the algebra R[X] is finitely generated and X is naturally identified 
with a connected component of the corresponding affine real algebraic variety (the real spectrum 
of R[X]). The natural linear representation of G in R[X] decomposes into a sum of mutually 
non-isomorphic absolutely irreducible finite dimensional representations whose highest weights A 
form a semigroup A. Let R[X]a be the irreducible component of R[X] with highest weight A, so 

R[X] = 0R[X] A . (2) 

AgA 

Denote by ip\ the highest weight function in R[X]> normalized by the condition 

tp\(o) = 1, 
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where o — eK is the base point of X. Then the subgroup S is the intersection of the stabilizers 
of all tp\'s. Its unipotent radical U is a maximal unipotent subgroup of G. 

The algebra R[HorX] is also finitely generated. The manifold HorX is naturally identified 
with a connected component of a quasi-affine algebraic variety, which is a Zariski open subset in 
the real spectrum of R[Hor A]. The natural linear representation of G in RfHorX] is isomorphic 
to the representation of G in R[X]. Let R[Hor A]> be the irreducible component of R[HorX] 
with highest weight A, so that 

R[HorA] = 0R[HorX] A . (3) 

AgA 

Denote by tp\ the highest weight function in R[Hor A],\ normalized by the condition 

MsUo) = 1, 

where s is the symmetry with respect to o and slJo — (sUs~ 1 )o is considered as a point of Hor A. 

The decomposition (||) defines a filtration of the algebra M[X] (see §ji| for the precise defini- 
tion). Let grR[A] be the associated graded algebra. There is a canonical G-equivariant algebra 
isomorphism 

T: grR[A] -> R[HorA] 

mapping each ip\ to rp\. As a G- module, grR[A] is canonically identified with R[X], so we can 
view L as a G- module isomorphism from R[A] to R[Hor A]. 

The horospherical Radon transform TZ is not defined for polynomial functions on X but its dual 
transform TZ* is defined for polynomial functions on Hor X, since it reduces to integrating along 
compact submanifolds. Moreover, as follows from the definition of polynomial functions, it maps 
polynomial functions on Hot X to polynomial functions on X. Obviously, it is G-equivariant. 
Thus, we have G-equivariant linear maps 

R[X] R[Hor X] ^ R[A]. 

Their composition TZ* o L is a G-equivariant linear operator on R[X], so 

(TZ*oT)(ip)=c xl p V^1[I] A , 

where the c\ are constants. To give a complete description of TZ* , it is therefore sufficient to find 
these constants. Our main result is the following theorem. 

Theorem 1 c\ = c(A + p), where c is the Harish- Chandra c-function and p is the half-sum of 
the positive roots of X (counted with multiplicities). 

The Harish-Chandra c-function governs the asymptotic behavior of the zonal spherical func- 
tions on X. A product formula for the c-function was found by S.G. Gindikin and F.I. Karpelevich 
[GK62]: for a rank-one Ricmannian symmetric space of the noncompact type, the c-function is 
a ratio of gamma functions involving only the root multiplicities; in the general case, it is the 
product of the c-functions for the rank-one symmetric spaces defined by the indivisible roots of 
the space. Thus, known the root structure of the symmetric space, the product formula makes 
the c-function, and hence our description of the dual horospherical Radon transform, explicitly 
computable. 

For convenience of the reader, we collect some crucial facts about the c-function in an appendix 
to this paper. 

The following basic notation will be used in the paper without further comments. 
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• Lie groups are denoted by capital Latin letters, and their Lie algebras by the corresponding 
small Gothic letters. 

• The dual space of a vector space V is denoted by V* . 

• The complexification of a real vector space V is denoted by V(C). 

• The centralizer (resp. the normalizer) of a subgroup H in a group G is denoted by Zg(H) 
(resp. N G (H)). 

• The centralizer (resp. the normalizer) of a subalgebra t) in a Lie algebra g is denoted by 
3„(fj) (resp. by tl B (f))). 

• If a group G acts on a set X, we denote by X G the subset of fixed points of G in X. 

2 Groups, spaces, and functions 

For any connected semisimple Lie group G admitting a faithful (finite-dimensional) linear rep- 
resentation, there is a connected complex algebraic group defined over R such that G is the 
connected component of the group of its real points. Among all such algebraic groups, there is 
a unique one such that all the others are its quotients. It is called the complex hull of G and 
is denoted by G(C). The group of real points of G(C) is denoted by G(R). If G(C) is simply 
connected, then G = G(R). 

The restrictions of polynomial functions on the algebraic group G(K) to G are called polyno- 
mial functions on G. They are precisely those differentiable functions <p for which the linear span 
of the functions gtp, g £ G, is finite dimensional (see e.g. JCSM95| , §11.8). (Here G is supposed to 
act on itself by left multiplications.) The polynomial functions on G constitute an algebra which 
we denote by K.[G] and which is naturally isomorphic to R[G(M)]. 

For any subgroup H C G, we denote by H(C) (resp. H(M)) its Zariski closure in G(C) (resp. 
G(K)). If H is Zariski closed in G, i.e. H = H(M.) n G, then H is a subgroup of finite index in 
H(M); if H is a semidirect product of a connected unipotent group and a compact group, then 
H = H(R). 

For a homogeneous space Y — G/H with 7? Zariski closed in G, set Y(C) = G(C)/H(C). This 
is an algebraic variety defined over K, and Y is naturally identified with a connected component 
of the variety Y(M) of real points of Y(C). We call Y(C) the complex hull of Y". 

If ii is reductive, then also H(C) is reductive and the variety Y(C) is affine, the algebra 
C[y(C)] being naturally isomorphic to the algebra C[G(<C)] H ^ of H (C)-right-invariant polyno- 
mial functions on G(C) (see e.g. [VP89], Section 4.7 and Theorem 4.10). Correspondingly, the 
algebra R[Y"(R)] is naturally isomorphic to M[G(R)] ff W . 

In general, the functions on Y(R) arising from ii (R)-right-invariant polynomial functions on 
G(R) are called polynomial functions on Y(M), and their restrictions to Y are called polynomial 
functions on Y. They are precisely those differentiable functions ip for which the linear span of 
the functions g(p, g E G, is finite dimensional. They form an algebra which we denote by M.[Y]. 

In the following we consider a semisimple Riemannian symmetric space X = G/K of non- 
compact type. This means that G is a connected semisimple Lie group without compact factors 
and if is a maximal compact subgroup of G. We do not assume that the center of G is trivial, so 
the action of G on X may be non-effective. We do, however, require that G has a faithful linear 
representation. According to the above, the space X is then a connected component of the affine 
algebraic variety A(M). 
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3 Subgroups and subalgebras 



We recall some facts about the structure of Riemannian symmetric spaces of noncompact type 
(see |Hcl78 for details). Let X = G/K be as above and 9 be the Cartan involution of G with 



respect to K , so K = G . Let a be a Cartan subalgebra for X , i.e. a maximal abelian subalgebra 
in the (— l)-eigenspace of d9. Its dimension r is called the rank of X. Under any representation 
of G, the elements of o are simultaneously diagonalizable. The group A = exp a is a maximal 
connected abelian subgroup of G such that 9(a) — a^ 1 for all a G A. It is isomorphic to (M^) r . 
Its Zariski closure A(M) in G(R) is a split algebraic torus which is isomorphic to (M*) r '. Let X(^4) 
denote the (additively written) group of real characters of the torus A(M). It is a free abelian 
group of rank r. We identify each character \ with its differential d\ S a*. 

The root decomposition of g with respect to A (or with respect to A(M), which is the same) 
is of the form 

8 = 80 + ^2 $a, 

aGA 

where go = 3s ( a )- If m : = 3e(a), then g = m + a. 

The set A C X(A) is the root system of X (or the restricted root system of G) with respect to 
A and g Q is the root subspace corresponding to a. The dimension of g Q is called the multiplicity 
of the root a and is denoted by m a . By the identification of a character with its differential, 
we will consider A as a subset of a*. Choose a system A + of positive roots in A. Let II = 
{qi, . . . , a r } C A + be the corresponding system of simple roots. Then 

C = {x G a : cti(x) > for i = 1, . . . , r} 

is called the Weyl chamber with respect to A + . The subspace 

is a maximal unipotent subalgebra of g. 
Set 

Go = Z G (A), M = Z K {A). 

Then Gq = M x A and the Lie algebras of Go and M are go and m, respectively. Clearly, Go is 
Zariski closed in G. 

The group U = exp u is a maximal unipotent subgroup of G. It is normalized by A and the 
map 

U X A X K — ► G, (u, a, fc) 1—* Mafc, 

is a diffeomorphism. The decomposition G = UAK (or G = KAU) is called the Iwasawa 
decomposition of G. Since every root subspace is Go-invariant, Go normalizes U, so 

P := [/Go = C/ X Go 



is a subgroup of G. Moreover, P — Nq(U) (see e.g. [War72|, Proposition 1.2.3.4), so P is Zariski 
closed in G. 

We say that a Zariski closed subgroup of G is parabolic, if its Zariski closure in G(C) is a 
parabolic subgroup of G(C). Then P is a minimal parabolic subgroup of G. The subgroup 

S := f/M = U\M 

of P is normal in P and PJ S is isomorphic to A. It follows from the Iwasawa decomposition that 
KDS = M. 
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4 Representations 



For later use we collect some well-known facts about finite-dimensional representations of G. 

The natural linear representation of G in M[X] decomposes into a sum of mutually non- 
isomorphic absolutely irreducible finite-dimensional representations called (finite-dimensional) 
spherical representations (sec e.g. [GW98], chap. 12). 



Theorem 2 (see [Hel84|, § V.4) An irreducible finite dimensional representation of G on a real 
vector space V is spherical if and only if the following equivalent conditions hold: 

(1) V K ^{0}. 

(2) V s ^{0}. 

If these conditions hold, then dimV K = dimV s = 1 and the subspace V s is invariant under P. 

For a spherical representation, the group P acts on V via multiplication by some character 
of P vanishing on S. The restriction of this character to A is called the highest weight of the 
representation. A spherical representation is uniquely determined by its highest weight. The 
highest weights of all irreducible spherical representations constitute a subsemigroup A C X(A). 

An explicit description of A as a subset of o* can be given as follows. Let A* denote the set 
of roots a E A such that 2a £ A. Then A* is a root system in a*, and a system of simple roots 
corresponding to A+ := A + n A* can be obtained from the system II = {ai, . . . , a r } of simple 
roots in A + by setting for j = 1, . . . , r 



Pi 

Let oji , . . . , uj r € a* be defined by 



if 2aj i A+, 
if 2ay G A+. 



(Wi ' A) =a«, (4) 



(Pi, Pi) 

where (•, •) denotes the scalar product in o* induced by an invariant scalar product in q 



Proposition 3 (see [Hel94], Proposition 4.23) The semigroup A is freely generated by . 



The weights uii, . . . , w r are called the restricted weights of X. 

For A £ A, let K[A]a denote the irreducible component of M[X] with highest weight A. Then 
we have 

K[A] = 0M[A] A . 
AeA 

We denote by ipf the highest weight function of K[A]a normalized by the condition 

<4( ) = i. 

(Since Po = PKo = Go = X , we have <pf(o) ^ 0.) Obviously, 

In general, the multiplication in M.[X) has the property 

M[A] A K[A% c R[Xl, 
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where "<" is the ordering in the group X(A) defined by the subsemigroup generated by the 
simple roots. In other words, the subspaces 



l[X' 



= 0W 



constitute a X(A)-filtration of the algebra R[X] with respect to the ordering "<". 

The functions ip £ R[X]a vanishing at o constitute a if-invariant subspace of codimension 1. 
The X-invariant complement of it is a 1-dimcnsional subspace, on which K acts trivially. Let 
(p^ denote the function of this subspace normalized by the condition v?a"(°) ~ 1- ^ is called the 
zonal spherical function of weight A. 



Lemma 4 (see e.g. [Hel84], p. 537) For any finite dimensional irreducible representation of G 
on a real vector space V there is a positive definite scalar product (• | •) on V such that 

{gx | Q(g)y) = (x\y) for all g EG and x, y £ V. 

This scalar product is unique up to a scalar multiple. 

The scalar product given by Lemma ^ is called G-skew- invariant. Note that it is if-invariant. 

With respect to the G-skew- invariant scalar product on R[X]a the zonal spherical function 
<p% is orthogonal to the subspace of functions vanishing at o £ X. Let a\ denote the angle 
between <p? and <pf . Then the projection of ip^ to = M.(pf is equal to (cos 2 ot\)<pf (see 

Figure 1). In particular, we see that ip^ and <pf are not orthogonal. 



<p(o)=l 




<p(o)=0 



Figure 1 

The weight decomposition of ip^ is of the form 

<P\ = (cos 2 a x )<pf + <?A lAt , 

for some weight vector p>\.^ of weight fi in R[X]a. This gives the asymptotic behavior of ip^ on 
(exp(— G°))o, where C° is the interior of the Weyl chamber G in a. More precisely, for £ £ C° 
we have 

p?((exp(-tO) ) = ((exp^VfXo) , ~ (cos 2 a x )e tx ^ . 

t — >+oo 



But it is known (see [ Hcl84 |, § IV. 6) that the same asymptotics is described in terms of the 
Harish- Chandra c-function: 

^((exp(-<0) ) ~ c(\ + p)e f ^\ 

t — > + OC 

where p = | J2 a eA+ m aOi is the half-sum of positive roots. This shows that 

cos 2 a a = c(A + p). 
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5 Horospheres 



Definition 5 A horosphere in X is an orbit of a maximal unipotent subgroup of G. 

Since all maximal unipotent subgroups are conjugate to U, any horosphere is of the form gUx 
(g E G, x E X). Moreover, since X = Po and P normalizes U, any horosphere can be represented 
in the form gUo (g E G). In other words, the set HorX of all horospheres is a homogeneous 
space of G. The following lemma shows that the G-set Hoi X is identified with G/S if we take 
the horosphere Uo as the base point for Hor A. 



Lemma 6 (see also [Hel94|, Theorem 1.1, p. 77) The stabilizer of the horosphere Uo is the 
algebraic subgroup 

S = UM = U\M. 

Proof. Obviously, S stabilizes Uo. Hence the stabilizer of Uo can be written as S = UM, where 

M CM C K. 

Since U is a maximal unipotent subgroup in G (and hence in S), it contains the unipotent radical 
U of S. The reductive group S/U can be decomposed as 

S/U = {U/U)M, 

so the manifold (S/U)/(U/U) is compact. But then the Iwasawa decomposition for S/U shows 
that the real rank of S/U equals 0, that is S/U is compact. This is possible only if U = U. 
Hence, 

S C N(U) = P = S X A. 
It follows from the Iwasawa decomposition G = AUK that S D A = {e}. Thus S = S. r-i 



As follows from [VP72|, the G-module structure of R[Hor X] is exactly the same as that 
of R[A], but in contrast to the case of R[A], the decomposition of R[Hor A] into the sum of 
irreducible components is a X(A)-grading. 

Let M[HorX]>, be the irreducible component of R[HorA] with highest weight A, so 

M[HorA] = 0R[HorX] A . 

AeA 

Denote by tpf and ip¥ the highest weight function and the K- invariant function in M[HorX]> 
normalized by 

1 pi(sUo)=^(sUo) = l. 

To see that this is possible, note that the horosphere sUo is stabilized by sSs" 1 — 0(S). Hence 
the subspace Vb of functions in R[HorX]A vanishing at sUo is 6'(S')-invariant. Its orthogonal 
complement is therefore 5-invariant and must coincide with R[Hor X]f. This implies tpf(sUo) ^ 
0, so we can normalize ipf as asserted. Since R[HorX]^ and R[Hor X]^ are not orthogonal in 
R[Hor X]x — R[X]\, we have R[Hor X]% n Vo = {0} and we can normalize also ifj\ as asserted. 
Notice that the horospheres passing through o form a single i^-orbit and therefore ip? takes the 
value 1 on each of them. 

Consider the X(A)-graded algebra grR[A] associated with the X(A)-filtration of M[X] defined 
in §^|. As a G-module, grR[A] can be identified with R[X], but when we multiply elements 
Lp\ E M\X]\ and ip^ E R[X] M in grR[A], only the highest term in their product in M[X] survives. 
Moreover, there is a unique G-equivariant linear isomorphism 

T: R[X] = grR[A] -> R[Hor X] 

such that T(tff) = i/jf. 
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Proposition 7 The map T is an isomorphism of the algebra grW[X] onto the algebra R[HorX]. 

Proof. For any semisimple complex algebraic group, the tensor product of the irreducible rep- 
resentations with highest weights A and p, contains a unique irreducible component with highest 
weight A + /i. It follows that, if we identify the irreducible components of M[X] with the corre- 
sponding irreducible components of R[HorX] via T, the product of functions p\ £ R[X]\ and 
ifn € in grMLY] differs from their product in M[HorX] only by some factor depending 

only on A and /i. Taking ip\ = ipf and ip^ = ip^, we conclude that = 1. rj 

Remark 8 The definition of T makes use of the choice of a base point o in X and a maximal 
unipotent subgroup U of G, but it is easy to see that all such pairs (o, U) are G-equivalent. It 
follows that r is in fact canonically defined. 



6 Proof of the Main Theorem 

Consider the double fibration 

G/M 




X = G/K G/S = HorX 

Since all the involved groups are unimodular, there are invariant measures on the homogeneous 
spaces X, HorX, G/M and on the fibers of p and q, which are the images under the action of G 
of K/M and S/M, respectively. Let us normalize these measures so that: 

(1) the volume of K/M is 1; 

(2) the measure on G/M is the product of the measures on K/M and X; 

(3) the measure on G/M is the product of the measures on S/M and HorX. 

(This leaves two free parameters). 

Consider the dual horospherical Radon transform 

TV : M[HorX] -> R[X}. 

Combining it with the map T defined in we obtain a G-equivariant linear isomorphism 

K'or: R[X] -► R[X}. 

In view of absolute irreducibility, Schur's lemma shows that 1Z* o T acts on each M[X]a by scalar 
multiplication. The scalars are given by the following theorem: 

Theorem 9 For ip eR[X] x , 

where c is the Harish- Chandra c-function. 

Proof. We test the map at the zonal spherical function ip^ € K[X]a- The map T takes it to 
C\tp^ for some c\ G M. Since the function i/j^ has value 1 on the horospheres passing through o, 
the map TZ* takes it to (p¥ . Thus we have 

(ft*or)(^) = CA¥ >f. 

Identifying M[X]a and R[Hor X]a via T, we now find c\ = cos 2 a\ (see Figure 2), and this proves 
the claim. 
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A Appendix: The c-function 

Because of the Iwasawa decomposition G — KAU, every g € G can be written as g = k exp H(g)u 
for a uniquely determined H(g) S a. Let U := 8(U), and let du denote the invariant measure on 
U normalized by the condition 

' e~ 2 ^ H ^ du = l. 



The c-function has been defined by Harish-Chandra as the integral 

c(A) := / e -fr+PWm M, 



Ju 

which absolutely converges for all A € a(C)* satisfying Re(A, a) > for all a G A + . The 
computation of the integral gives the so-called Gindikin-Karpelevich product formula [GK62 
(see also jlejfg l, Section IV.6.4, or pV8§ , p. 179): 

c(a) = « n -n tv r / ( x a) v (5) 

V 2 4 2y V 2 4 2 

where A ++ denotes the set of indivisible roots in A + , A Q := ! A '°| , and the constant k is chosen 
so that c(p) = 1. This formula provides the explicit meromorphic continuation of c to the entire 
a(C)*. 

Formula (||) simplifies in the case of a reduced root system (i.e. when A ++ = A+), since the 
duplication formula 

T(2z) = 2 2z - 1 V^T(z)T{z + 1/2) (6) 

for the gamma function yields 



with 



tt r(p a + mg/2) 
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If, moreover, all the multiplicities m a are even (which is equivalent to the property that all 
Cartan subalgebras of q are conjugate), then the functional equation zT(z) — T(z + 1) implies 



,.s _ TT Pa(Pa + 1) ■ ■ ■ (jOq + m a /2 - 1) 

CU ~ A A A Q (A Q + l)...(A„+m Q /2-l)' 

Finally, suppose that the group G admits a complex structure. In this case the root system 
is reduced and m a — 2 for every root a, and (Q) reduces to 

c« . n 

aeA+ 



Example 10 For n-dimensional Lobachevsky space, there is only one positive root a, with 
m a = n — 1, so p = (n — l)a/2. Let A = la. Then formula (Q) gives 

r(n-i)r(Q 
c ^ r(^)r(z + i^i)- 

The semigroup A is generated by a. For A — la (I e N), we obtain 

(n + l-l)[n + l)---(n + 2l-2) 

T(n--\)r(l + H^-) ! 

ca = c(A + p) = 



n even, 



r(n - i)r(z + 2=±) _ I 2 2J f(§ + i) ■••(§ + /- 1) ' 
r(2=i)r(/ + n -i) " | (^ + i)(V + 2 )---( Ii 2 i + '- 1 i ?10dd 



2n(n+ !)•••(« + /- 2) 
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